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Abstract 

In this paper, under some weaker conditions, we give three laws of 
large numbers under sublinear expectations (capacities), which extend 
Peng's law of large numbers under sublinear expectations in [8] and 
Chen's strong law of large numbers for capacities in [1]. It turns out 
that these theorems are natural extensions of the classical strong (weak) 
laws of large numbers to the case where probability measures are no 
longer additive. 
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1 Introduction 



The classical strong (weak) laws of large numbers (strong (weak) LLN) as fundamental 
limit theorems in probability theory play a fruitful role in the development of probability 
theory and its applications. However, these kinds of limit theorems have always considered 
additive probabilities and additive expectations. In fact, the additivity of probabilities 
and expectations has been abandoned in some areas because many uncertain phenomena 
can not be well modelled by using additive probabilities and additive expectations. Mo- 
tivated by some problems in mathematical economics, statistics and quantum mechanics, 
a number of papers have used non-additive probabilities (called capacities) and nonlinear 
expectations (for example Choquet integral/expectation, (yf-expectation) to describe and 
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interpret the phenomena. Recently, motivated by the risk measures, super-hedge pricing 
and model uncertainty in finance, Peng [5-9] initiated the notion of independent and iden- 
tically distributed (IID) random variables under sublinear expectations. Furthermore, he 
showed law of large numbers (LLN) and central limit theorem (CLT) under sublinear 
expectations. In [1], Chen presented a strong law of large numbers for capacities induced 
by sublinear expectations with the notion of IID random variables initiated by Peng. 

The purpose of this paper is to investigate one of the very important fundamental 
results in the theory of Peng's sublinear expectations: tlaw of large numbers. All of the 
results on laws of large numbers in [1] and [8] require that the sequence of random variables 
is independent and identically distributed. In this paper we intend to obtain three laws 
of large numbers without the requirement of identical distribution. Under some weaker 
conditions, we prove three laws of large numbers under Peng's sublinear expectations, 
which extend Peng's law of large numbers under sublinear expectations in [8] and Chen's 
strong law of large numbers for capacities in [1]. 

This paper is organized as follows: in Section 2, we recall some notions and lemmas 
under sublinear expectations. In Section 3, we give our main results including the proofs. 

2 Notions and Lemmas 

In this section, we present some preliminaries in the theory of sublinear expectations. 

DEFINITION 2.1 (see [5-9]). Let be a given set and let ?^ be a hnear space of real 
valued functions defined on Q. We assume that all constants are in H and that X e H 
implies |X| G "H. is considered as the space of our "random variables". A nonlinear 
expectation E on "H is a functional E : ?^ i-^ M satisfying the following properties: for all 
X, Y ^Ti, we have 

(a) Monotonicity: IiX>Y then E[X] > EY]. 

(b) Constant preserving: E[c] = c. 

The triple {fl, T-L, E) is called a nonlinear expectation space (compare with a probability 
space J-", P)). We are mainly concerned with sublinear expectation where the expec- 
tation E satisfies also 

(c) Sub-additivity: E[X] - E[Y] < E[X - Y]. 

(d) Positive homogeneity: E[XX] = XE[X], VA > 0. 

If only (c) and (d) are satisfied, E is called a sublinear functional. 

The following representation theorem for sublinear expectations is very useful (see 
Peng [8, 9] for the proof). 

LEMMA 2.1. Let E be a sublinear functional defined on (Q.'H), i.e., (c) and (d) hold 
for E. Then there exists a family {Eg : ^ e 6} of hnear functionals on (Q, H) such that 



E[X] = nvAxEg 
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If (a) and (b) also hold, then Ee are linear expectations for ^ e ©. If we make furthermore 
the following assumption: (H) For each sequence C such that X„(cj) l for 

CO, we have -E[X„] I 0. Then for each 6* G 0, there exists a unique (cr-additive) probability 
measure Pq defined on {fl,a{T-L)) such that 

EelX] = / X{uj)dPe{u), XeH. 
Jn 

REMARK 2.1. Lemma 2.1 shows that under (if), indeed, a stronger representation 
holds. That is, if E is a sublinear expectation on T-L satisfying (H), then there exists a set 
(say V) of probability measures such that 

m = sup Ep[^], -E[-e] = inf Ep[^]. 
Pg-p Pev 

Therefore, without confusion, we sometimes call supremum expectations as sublinear ex- 
pectations. 

Given a sublinear expectation E, let us denote the conjugate expectation £ of sublinear 
E by 

S[X] :^ -E[-X], yXeH 

Obviously, for all XeH, S[X] < E[X]. 

Furthermore, let us denote a pair (V, v) of capacities by 

V(^):=E[7^], v{A) :^ £[Ia], ^AeT. 

It is easy to check that 

v(A) + v{A') = 1, yAeT 

where A^ is the complement set of A. 

DEFINITION 2.2. A set function V: T ^ [0, 1] is called upper continuous capacity if 
it satisfies 

(1) y(0) = o,y(Q) = i. 

(2) V{A) < V{B), whenever A C B and A, B e J^. 

(3) V{An) i V{A), if An i A, where A^, A e J^. 

ASSUMPTION A. Throughout this paper, we assume that E is a sublinear expecta- 
tion, V is an upper continuous capacity generated by sublinear expectation E. 

The following is the notion of IID random variables under sublinear expectations in- 
troduced by Peng [5-9]. 
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DEFINITION 2.3. Independence: Suppose that Yi,Y2,-- - ,Yn is a sequence of 
random variables such that Yi E Ti. Random variable Yn is said to be independent to 
X := (Yi, ■ ■ ■ , F„_i) under E, if for each measurable function (p on R"^ with (p{X, Y^) G T-L 
and ip{x, Yn) G for each x G W^'^, we have 

E[ip{X,Yn)]^E[Tp{X)], 

where ^(x) := ¥,[ip{x, Yn)] and ^{X) G 

Identical distribution: Random variables X and F are said to be identically dis- 
tributed, denoted hy X ^Y, if for each (p such that (p{X), (p{Y) G T-L, 

E[^(x)]=E[^(y)]. 

Sequence of IID random variables: A sequence of IID random sequence {Xi}°^^ is 

said to be IID random variables, if Xi = Xi and Xi+i is independent to Y :— {Xi, • • • , Xi) 
for each i > 1. 

The following lemma shows the relation between Peng's independence and pairwise 
independence in Maccheroni and Marinacci [3] and Marinacci [4]. 

LEMMA 2.2 (see Chen [1]). Suppose that X,Y e T-L are two random variables. E is 

a sub-linear expectation and (V, v) is the pair of capacities generated by E. If random 
variable X is independent to Y under E, then X also is pairwise independent to Y under 
capacities V, and v e.g. for all subsets D and G G i3(M), 

V{X eD,Y eG)^ V{X G D)V{Y G G) 

holds for both capacities V and v. 

Borel-Cantelli Lemma is still true for capacity under some assumptions. 

LEMMA 2.3 (see Chen [1]). Let {An,n > 1} be a sequence of events in J* and (¥,v) 
be a pair of capacities generated by sublinear expectation E. 

oo / oo oo \ 

(1) If E V(/l,) < oo, then V n U A = 0. 

n=l \n=l i=n J 

(2) Suppose that {^AniU > 1} are pairwise independent with respect to v, e.g. 

(oo \ oo 

i=l / i=l 

oo 

If E V(A„) = OO, then 

n=l 

(oo oo \ 
nu^. =1- 
n=l i=n / 
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DEFINITION 2.4 ( Maximal distribution) (see Peng [8, 9]). Let Cb,Lip(M) denote the 
space of bounded and Lipschitz continuous functions. A random variable rj on sublinear 
expectation space (ilj'HjE) is called maximal distributed if 

E[(p{ri)] = sup_(^(y), V(/7 e Cb,Lip{^): 

jj,<y<fj, 

where JI :— Efr^] and /i :— S[r}]. 

REMARK 2.2 (see Peng [8, 9]). Let r] be maximal distributed with /J = E[r]], fi = £[r]], 
the distribution of rj is characterized by the following parabohc PDE: 

dtu - g{dxu) = 0, u{0,x) = (p{x), 

where u(t, x) := K[ip{x + tr])], {t, x) e [0, oo) x M, g{x) := Jlx'^ — iix~ and x"*" := max{x, 0}, 
x~ := {—x)~^. 

With the notion of IID under sublinear expectations, Peng shows a law of large num- 
bers under sublinear expectations (see Theorem 5.1 in Peng [8]). 

LEMMA 2.4 (Law of large numbers under sublinear expectations). Let {Xi}°Zi 
be a sequence of IID random variables with finite means JI — IE[Xi], /i — S[Xi]. Suppose 
E[|Xip] < oo. Then for any continuous and linear growth function (p, 




— )■ sup 'f{y), as n — >■ oo. 



The following lemma is a strong law of large numbers for capacities, which can be 
found in Chen [1]. 

LEMMA 2.5 ( Strong law of leirge numbers for capacities). Let {Xi}°^^ be a 

sequence of IID random variables for sublinear expectation E. Suppose E[|Xip] < oo. 

n 

Set Ji := E[Xi], ^ := S[Xi\ and 5„ := J2 ^i- Then 

1=1 

(I) 

V ( fjL < lim ini Sji/n < limsup5'„/n < /I ) =1. 

n-*oo „^oo J 

(H) 

V I limsup5'„/n — Jl]—!, V ( lim inf — /j,] — 1. 

(III) V6e[/.,7i], 

Vl'liminf |5„/n-6| = o) = L 
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3 Main Results 

3.1 General law of large numbers under sublinear expectations 

THEOREM 3.1 (General law of Icirge numbers under sublineair expectations). 

Let a sequence {Xi}'?Zi which is in a subhnear expectation space {fl,H,'E) satisfy the 
following conditions: 

(i) each Xj+i is independent of {Xi, ■ ■ ■ , Xi), for i = 1, 2, • • • ; 

(ii) E[Xj] = /Ij, S[Xi] = fii, where — oo < /Xj < /Ij < oo; 

(iii) there are two constants /7 and fj, such that 

^ n \ ^ 

lim —} \ni — — 0, lim — — 7J| = 0; 

i=l i=l 

(iv) supE[|Xjp] < oo. Then for any continuous and linear growth function (p, 



E 



n . 
1=1 



sup (p{y), as n — >■ oo. 



PROOF. The main idea comes from Theorem 3.1 Li and Shi [2]. First we prove the case 
that (/9 is a bounded and Lipschitz continuous function. For a small but fixed h > 0, Let 
V be the unique viscosity solution of the following equation 

dtV + g{d^V) ^ 0, {t,x) e[0,l + h]xR, V{1 + h,x) ^ cp{x), (1) 

where g{x) := Jlx~^ — iJ,x~ . According to the definition of maximal distribution, we have 

V{t, x) = E[ip{x + {l + h- t)rj)]. 

Particularly, 

V{h,0)^E[cp{rj)], V{l + h,x)^cp{x). (2) 

Since (1) is a uniformly parabohc PDE, by the interior regularity of V (see Wang [10]), 
we have 

||y||(7i+a/2,i+a([o,i]xR) < some a e (0, 1). 

We set 5 := i and So := 0. Then 

n-1 

Vil, 5Sn) - V{0, 0) = E {V{{i + m 5S,+,) - V{i5, 5S,)} 

n-1 

= E {[V{{t + 1)S, SSi+,) - V{iS, SSi+i)] + [V{iS, SSi+,) - V{iS, 5Si)]} 

1=0 
n-1 

1=0 
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with, by Taylor's expansion, 

4 = dtV{iS, SSi)S + d,V{iS, 6S,)X,+,6, 

[dtV{{t + /3)6, 6S^+i) - dtV{z6, 6S^+,)] d(3d 



+ [dtV{tS,SSi+i)-dtV{iS,SSi)]5 
+ [d,V{iS, 6Si + /36Xi+,) - d,V{i5, 6Si)] d/3Xi+,S. 



Thus 



E 



n— 1 
.1=0 



S 



n— 1 
.1=0 



<E[y(i,55„)] -y(o,o) <E 



n-l 
.1=0 



E 



ri— 1 

E^i 

.1=0 . 



(3) 



Prom (1) as well as the independence of Xj+i to {Xi, • • • , Xj), it follows that 

E[Jj] = E [dtVit5, 6S.i)5 + d,Vit6, 6Si)Xi+,6] 

- E {9*1/(^5, 6Si)6 + 5[{d^V{t5, 5S,)yjI-^ - (d^^Vitd, } 

<E{dtV{i6, 6Si)6 + S[{d^V{i6, 6Si)yjI - {d^V{i6,6Si))- fx]} 

+5E[(d,V(i5, 5Si))+(jHri -Ji) + (d,V(i5, - /x)] 

= 6E[{d,V{iS, 55,))+(7i^ - 71) + 5S',))-(/^ - //)] 

< 5(|7l-;i - 7I| + l/x^ - /x|)E[|a,V^(i5, 5Si)\]. 

But since both and dxV are uniformly cc-holder continuous in x and —holder contin- 
uous in t on [0, 1] x M, it follows that 

\d,V{i5,5Si)-d,V{0,0)\<C\5Si\'' + \i5\^, 

where C is some positive constant. Since 

E[|(55i|"] < E[\SSi\] + 1 < supE[|Xi|] + 1. 

i>i 

Hence, by (iv), we claim that there exists a constant Ci > 0, such that 

E[\d,V{i5,5Si)\]<Ci. 

Then we obtain 



E 



n-l 

E^j 



n— 1 n— 1 

i=0 i=0 



< 0. 



"n— 1 
,i=0 J 

In a similar manner of the above, we also have 



From (iii), we have limsupE 



E 



n-l 

E^^ 

.1=0 



n-l 

>-J2s{\jkri-ii\ + \!M+i- !A)E[\d,v{zs, sSi)\]. 

i=0 
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By (iii), it follows that liminf E 



n-l 
,i=0 



> 0. So we can claim that 



lim E 



rt— 1 
i=0 



0. 



(4) 



For II, since both dtV and dxV are uniformly a-holder continuous in x and —holder 
continuous in t on [0, 1] x M, we then have 



It follows that 



Thus 



E[\li\]<C5^+-/'{l+E[\Xi+^\-]+E[\X,+,\^+-]). 



n-l 

-C&i E (1 + E m^i^ + E + E 

i=0 



<E[Vil,6Sn)]-ViO,0) 

n— 1 

< C{^)H E (1 + E [\X,^in + E + E 

1=0 

Therefore, from (iv) and (4), as n — >■ oo, we have 

lim E[V{l,6Sn)] = V(0,0). 

n— >oo 

On the other hand, for each t, t' e [0, 1 + /i] and x e R, 

\V{t,x) -V{t,x)\ < C\t-t\. 

Thus 

\V{0,0) -V{h,0)\ < Ch 

\E[Vil,5Sn)]-E[^{5Sn)]\ 
= \E[V{1, SSn)] - E[V{1 + h, 6Sn) I < Ch. 



n-l ■ 

E^J 

.1=0 

n-l 

E^l 

i=0 



and, by (2) 



It follows from (6)- (8) that 

lim sup 



E 



n 



-E[(^(77)] 



< 2Ch. 



Since h can be arbitrarily small, we have 



lim E 

n— >oo 



n 



E[(p{v)] = sup_(p{y). 



(5) 



(6) 



(7) 
(8) 



The rest proof of Theorem 3.1 is very similar to that of Lemma 5.5 in peng [8]. So we 
omit it. 
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Prom Theorem 3.1, we easily claim the following corollary. 

COROLLARY 3.1. Let a sequence {Xi}'^^ which is in a sublinear expectation space 
{fl, H, E) satisfy the following conditions: 

(i) each Xj+i is independent of {Xi, • • • , Xj), for i = 1, 2, • • • ; 

(ii) E[Xj] = /Ij, S[Xi\ — II., where — oo < fi. <]Ii < oo; 

(iii) there are two constants JI and /i such that lim /i. — /i, lim JI- — JI; 

(iv) supE[|Xjp] < oo. Then for any continuous and linear growth function (p, 



i>l 



E 



sup ifiiy), as n — >■ oo. 

ti<y<Ji 



3.2 General strong law of large numbers for capacities induced 
by sublinear expectations 



THEOREM 3.2 (General strong law of Icirge numbers for capacities). Under 
the conditions of Theorem 3.1, then 



(I) 



(II) V6e[/x,7Z], 



y^n X- 

V [ ji < lim inf — — — - < lim sup — — — - < JI 



— n— >-oo 



n 



( liminf 






n 



n 



=1. 



(Ill) 



V ( lim sup 



n 



/7 = 1, V liminf 

n—^oo 



n 



In order to prove Theorem 3.2, we need the following lemma. 
LEMMA 3.1 (see Chen [1]). In a sublinear expectation space {Q,H,E), let {Xi}°^^ be 
a sequence of independent random variables such that supEflXjp] < oo. Suppose that 



i>l 



there exists a constant C > such that 

\X„-E[X„]\<C- 



n 



n=l,2. 



log(l + n) ' 

Then there exists a sufficiently large number m > 1 such that 

'mlog(l + n 



sup E 

n>l 



exp 



n 



< OO. 



Where Sn:^E[Xi-nXi 

i=l 
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PROOF OF THEOREM 3.2. First, it is easy to show that (I) is equivalent to the 
conjunction of 



V ( hmsup ^'=^ > 71 1 = 0, 



n 



V ( hminf ^'=1^' < ^ ) = 0. 



n— >-oo n 



Indeed, write A := < hmsup — - > Jl> , B := { hminf — - < ? , the equivaL 
can be proved from the inequahty 

max{V(A),1/(fi)} <N(A[jB\ <\{A)+N{B). 



(9) 
(10) 
ence 



We shah turn the proofs of ([9]) and ( ITOl) into two steps. 

Step 1 Assume that there exists a constant C > such that |X„ — 7I„| < ^^^^'^^-^ for 
n > 1. To prove ([9]), we shaU show that for any £ > 0, 



00 00 ^— \71 



V nu 



> £ 



0. 



'Ill 



^n=l i=n 

Indeed, by Lemma 3.1, for any e > 0, let us choose m> 1/e such that 

m log(l + n) 



sup E 

n>l 

By Chebyshev's inequality. 



exp 



n 



1=1 



< 00. 



V (^EIU(azEd > ^) = V (^I^il^|:(X, em log(l + n)) 



g-emlog(l+n)jg 



< (TT^supE 

n>l 



exp 



exp 



m log(l+n) 



m log(l+n) 



i=l 



Since em > 1, and supE 



n>l 



exp 



m log(l+n) 



i=l 



< 00. It then follows from the 



convergence of {i+ny^ ^ we have 



n=l 



n=l 



> £ < 00. 



Using the first Borel-Cantelli Lemma, we have 



V ( limsup ^'=^^^' > £ 1 = V£ > 0, 



n 
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which imphes 



Also 



V ( hmsup ^^=; > 71 ) = 0. 



n 



V ( hmsup — — — - <Jl\ = 1. 

n— >-oo IT- 



Similarly, considering the sequence {— By step 1, it suffices to obtain 



V hm sup =^ > 1 = 0. 



n 



Hence, 



Also 



V ( liminf <n \ =0. 



V ( hminf — — — - > jjt,] —1. 



Step 2. Write 



It is easy to check that {Xi}^^ satisfies the assumptions in Lemma 3.1. Indeed, obviously 
for each n > 1, 

— _ 2Cn 
'^"~^"'-log(l + n)- 
On the other hand, for each n > 1, it easy to check that 

\Xn-JlJ < |X„ -/7„| +E[|X„ -77„|]. 

Then, by (iv), 

E[|X„ - JtJ'] < 4 (E[|X„ - JtJ] + (E[|X„ - 7ZJ])2) < 00. 

n 

Set Sn '■= '^{Xi —Jii), immediately, 

i=l 



1=1 i=l i=l 



Since supE[|Xj|^] < 00, we have 

i>l 



l>log(l+i)}J 

(12) 



00 

E 

i=l 



i=l 



< C^E-^<oc. 
1=1 
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1 " 

-^E[|.Y,-7r.|/{,,._^_„^}]^0. (13) 

1=1 

Furthermore, write Ai := — /Zj > i^^i^^-^ | for i > 1. It suffices now to prove that 

/ oo oo \ 



\n=l i=n 



Indeed, by Chebyshev's inequality. 



a \ /iog(i + i)^^ 



Hence, 



< oo 



and by the ffist Borel-Cantelli Lemma, we have V j f] |J j = 0. 

\n=l i=n 

oo 

This implies that co ^ f] IJ sequence 

n=l i=n 



E 

i=l 

converges almost surely with respect to V as n — )■ oo. Applying Kronecker Lemma again, 
-^(|.Y.-K|/{|,,__„_^,)-^0,a.s V. (14) 

1=1 

Set limsup on both side of f lT2|) . then by f fT3|) and f|T^ . we have 
hmsup < hmsup — , a.s. V. 

n->oo IT- n—^oo ^ 

Since {Xn}^=i satisfies the assumption of Step 1, by Step 1, 

V Aim sup S^i^ > 77^ = 0. 



Also 



V Aim sup ^'=^ <-^=l. 
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In a similar manner, we can prove 

V ( liminf ^'=^ > /X 1 = 1. 

y n->oo n ^ 

Therefore, the proof of (I) is complete. 

To prove (11). Denote Sn ■= ^ Yl^=i-^i- If = A*) it is trivial. Suppose Ji > fi, we 
prove that, for any 6 e (/^, A*) 



V 



fliminf = o) - 1. 

\ n— >oo / 



To do SO, we only need to prove that there exists an increasing subsequence {n^} of {n} 
such that for any 6 e (a*, A*) 



V n [J{\SnJnk-b\<e}]^l. 



\m=l k=m 

Indeed, for any < £ < min{71 — 6, 6 — //}, let us choose Uk — lor k >1. 

n 

Set 5„ := then 

i=l 



V 



n/c-n/t_i 



<ej = V 

= V 

= V 

> E 



Sn^-,L^._^ -(";v-'ifc-i)'> 



< £ 



where <;/)(x) is defined by 



0, bl > £. 



Considering the sequence of random variables {X^ — Obviously 

Applying Theorem 3.1, we have, as A; ^ oo, 

S. 



E 



Thus 



k=l 



Uk - rik-i 



sup = 0(0) = 1 - e > 0. 

/i— 6<2/<p— 6 



rife - rik-i 



<e] > 



EE 

k=l 



Uk - Uk-l 



oo. 



(15) 
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Note the fact that the sequence of {Sj^. — Sn^_^}k>i is independent for all /c > 1 . Using 
the second Borel-Cantelli Lemma, we have 



lim inf 

k-^oo 



Uk - rik-i 



< e, a.s. V. 



But 





< 







-b 



Uk - rik-i 



rik 



+ 



1^, 



"■k-i I 



rik-i 



n-k-i 
rik 



Noting the following fact, 



1, > 0, as K ^ oo 



n-k 



n-k 



and 



which implies 



limsupjS'n/n < /i, limsup(— < — //, 



limsup \Sn\/n < max{|/x|, < oo. 

n— >oo 

Hence, from inequality (16), for any £ > 0, 

Sn 



lim inf 

fe— >-oo 



rik 



<e, a.s. V. 



That is 



Vfliminf I^Jn-^l < = 1. 
Since e can be arbitrarily small, we have 

Vfliminf |5„/n-6| = o) = 1. 

Now we prove that 

V I limsup5'„/n = /Z j = 1, V (liminf = A*) =1. 

Indeed, from V (liminf I— — 6| = 0) = 1, V6 e we can obtain 



Then 



V ( limsup — > 6 ) = 1. 

n—^oo IT- 



V ( limsup — > ) =1. 

n— >oo ri 



(16) 
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On the other hand, we have, for each P e V, 

P (hmsup — \ — P [hmsup — > /7 ) + P(hmsup — <JL) — 1. 

But 



P I hmsup — < A* [ n < hminf — < hmsup — < A* = 1- 



Thus 



V Him sup — — 

\ n— >oo J 



In a similar manner, we can obtain 



V ( liminf — = 1 =1. 

n->oo 77, 



The proof of Theorem 3.2 is complete. 

3.2 General weak law of large numbers for capacities induced by 
sublinear expectations 

THEOREM 3.3 (General weEik law of Icirge numbers for capacities). Under the 
conditions of Theorem 3.1, then for any £ > 0, 

lim w I - e (/i-£,7I + £) I = 1. (17) 

— v^tr - ) 

PROOF. To prove (17), we only need to prove that 



and 



Now we prove 



lim V ( -VXi <[i-e \ =0 
— \n^^ - ) 

lim V i-y^Xi > + £ 1 = 0. 

™ Vti - J 

lim V I - V < /X - £ 1 =0. 



For any 5 < e, construct two functions /, g such that 

f{x) = 1 for X < n — e — S, 
f{x) —0 for x> ji — e, 
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and 



f{x) = -{^ — e — x) for fj, — 6 — 6<x<fi — e 



g{x) = 1 for X < fl — e, 
g{x) = for X > fl — e + 6, 

g{x) = -(/i — e — x) + 1 for ft — e<x<fi — e + S. 



Obviously, / and g G Cb^upiM). By Theorem 3.1, we have 



hm E 

n—^oo 



hm E 

n—^oo 



i=l 



sup_/(2/) = 0, 

fi<y<fj, 



snp_g{y) = 0. 



So 



= sup f{y) < hm inf V ( — \^ Xi < fi — e] < hm sup V ( — \^ Xi < fi — e] < sup g{y) = 0. 

(18) 



Hence 



hm V f i V Xi < ^ - £ I = 0. 



In a similar manner, we can obtain 



lim V ( - >fi + e] = 0. 

n-s>oo \n ^—^ — j 



The proof of Theorem 3.3 is complete. 
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